Papers with LLM confidence estimation
MAC-Tuning: LLM Multi-Compositional Problem Reasoning with Enhanced Knowledge Boundary Awareness (2025.emnlp-main)
Copied to clipboard
| Challenge: | Large language models produce non-existing facts when faced with questions outside their parametric knowledge, which undermines their reliability. |
| Approach: | They propose a method that separates the learning of answer prediction and confidence estimation during fine-tuning on instruction data. |
| Outcome: | Experiments on multiple models and different model sizes show that the proposed method outperforms baselines by up to 25% in average precision. |
A Survey of Confidence Estimation and Calibration in Large Language Models (2024.naacl-long)
Copied to clipboard
| Challenge: | Large language models (LLMs) have demonstrated impressive capabilities across a wide range of tasks in various domains, but they can be unreliable due to factual errors in their generations. |
| Approach: | They summarize recent advances in LLM confidence estimation and calibration and outline their main lessons learned. |
| Outcome: | The proposed methods can be used to assess the reliability of models and to calibrate them across tasks. |